OPEN 3 ACCESS Freely available online 



•0-PLOS I o-^E 



Effects of Baseline Problematic Alcohol and Drug Use on (St\ 
Internet-Based Cognitive Behavioral Therapy Outcomes crossMark 
for Depression, Panic Disorder and Social Anxiety 
Disorder 

Mikael Gajecki^% Anne H. Berman^'^, Kristina Sinadinovic^'^, Claes Andersson^'^'^, Brjann Ljotsson^, 
Erik Hedman^ Christian Riick^ Nils Lindefors^ 

1 Center for Psychiatric Research, Department of Clinical Neuroscience, Karolinska Institutet, Stockholm, Sweden, 2 Stockholm Center for Dependency Disorders, 
Stockholm, Sweden, 3 Health and Society, Department of Criminology, Malmo University, Malmo, Sweden, 4 Department of Clinical Sciences, Division of Psychiatry, Lund 
University, Lund, Sweden, 5 Department of Clinical Neuroscience, Division of Psychology, Karolinska Institutet, Stockholm, Sweden, 6 Department of Clinical Neuroscience, 
Division of Psychiatry, Karolinska Institutet, Stockholm, Sweden 



Abstract 

Purpose: Patients' problematic substance use prevalence and effects were explored In relation to internet-based cognitive 
behavioral therapy (ICBT) outconnes for depression, panic disorder and social anxiety disorder. 

Methods: At baseline and treatnnent conclusion, 1601 ICBT patients were assessed with self-rated measures for alcohol and 
drug use (AUDIT/DUDIT), depressive symptoms (MADRS-S), panic disorder symptoms (PDSS-SR) and social anxiety 
symptoms (LSAS-SR). 

Results: Problematic substance use (AUDIT >8 for men, >6 for women; DUDIT >1) occurred among 32.4% of the patients; 
24.1% only alcohol, 4.6% only drugs, and 3.7% combined alcohol and drug use. Hazardous alcohol use and probable alcohol 
dependence negatively affected panic disorder outcomes, and hazardous drug use led to worse social anxiety outcomes. 
Depression outcomes were not affected by substance use. Treatment adherence was negatively affected by problematic 
drug use among men and 25-34 year olds; combined substance use negatively affected adherence for women and 35-64 
year olds. 

Conclusion: Problematic substance use does not preclude ICBT treatment but can worsen outcomes, particularly 
problematic alcohol use for panic disorder patients and hazardous drug use for social anxiety patients. ICBT clinicians should 
exercise particular caution when treating men and younger patients with problematic drug use, and women or older 
patients with combined substance use. 
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introduction 

Considerable evidence indicates an association between psychi- 
atric disorders and problematic substance use. Individuals 
diagnosed with a psychiatric disorder run double the risk of being 
diagnosed with an alcohol use disorder and four times the risk of 
being diagnosed with a drug use disorder, compared to those 
without a psychiatric disorder [1]. In a US national survey, the 12- 
month prevalence level of a diagnosed alcohol use disorder among 
individuals with a mood disorder was 17.3% and 6.9% for a drug 
use disorder. Among individuals with an anxiety disorder, 12- 
month prevalences were 13.0% and 4.6% respectively. In 
comparison, prevalences in the general population were lower - 
8.5% for diagnosed alcohol and 2% for drug use disorders. Among 



those seeking treatment for major depressive disorder, panic 
disorder with agoraphobia, panic disorder without agoraphobia 
and social anxiety disorder the 12-month prevalences for an 
alcohol use disorder were 16.8%, 15.4%, 13.7% and 16.0% 
respectively. The corresponding numbers for a drug use disorder 
were 7.5%, 9.7%, 5.1% and 8.2% [2]. 

In Sweden, about one-fourth of non-psychotic patients at 
psychiatric outpatient clinics have indicated problematic alcohol 
use [3], and almost 10% of psychotic patients have problematic 
drug use [4], higher levels than among the general population, 
where 21.1% show problematic alcohol use, and 2.8% indicate 
problematic drug use [5] . The causes of increased substance use 
among patients with psychiatric disorders are not well studied, but 
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one explanation could be self-medication [6-8]. Accordingly, 
studies have shown that development of common psychiatric 
disorders such as social anxiety disorder typically precedes the 
onset of substance abuse [9-11]. Initial substance use can 
conversely induce psychiatric disorders [12-14]. 

Surprisingly, little research seems to have been conducted about 
the effects of problematic substance use on psychotherapeutic 
treatment outcomes. A search for studies specifically examining 
how substance use affects the outcome of psychotherapeutic 
treatment for depression returned no results. In the area of anxiety 
disorders, a naturalistic 12-year study showed that concurrent 
alcohol or other SUDs did not affect social anxiety disorder and 
panic disorder outcomes [15]. In another study, pre-treatment 
problematic alcohol use levels did not predict treatment outcomes 
for social anxiety disorder or panic disorder; however, lower pre- 
treatment drinking levels led to greater improvement in social 
interaction anxiety [16]. A systematic review of predictors for 
dropout and treatment outcomes following CBT for social anxiety 
disorder examined alcohol and general substance use as predictors 
for treatment outcomes without finding any association [17]. 

A recent development in the psychiatric treatment of mental 
disorders is internet-based cognitive behavioral therapy (ICBT). 
ICBT has shown effect sizes similar to traditional therapy 
0 = 0.91; 95% confidence interval (CI) 0.68-1.14) for affective 
as well as anxiety disorders of mild or moderate severity [18,19]. 
Although research on treatment outcomes for internet-deUvered 
psychotherapy for various diagnostic categories has increased 
exponentially over the past few years [20-22], a literature search 
using the terms "online therapy, e-therapy, alcohol, substance use, 
alcohohsm, drug abuse, drug usage and c-fTec t" yic-kled no research 
about SUD effects on internet-based psychotherapy treatment 
outcomes. The litde published research available from disparate 
studies suggests that SUDs do not seem to affect psychiatric 
treatment outcomes, running counter to standard psychiatric 
recommendations for integrated treatment for concurrent psychi- 
atric and SUDs, at least for severe mental illness [23]. 
Furthermore, empirical evidence concerning the prevalence of 
SUD among patients seeking treatment with ICBT for depression, 
panic disorder and social anxiety disorder is scarce. 

To the best of our knowledge, this is the first study investigating 
the effects of problematic substance use on ICBT outcomes. We 
first explored the prevalence of problematic alcohol and drug use 
among patients treated for depression, panic disorder and social 
anxiety disorder at an ICBT unit within ordinary psychiatric care 
in Sweden and, secondly, assessed the effects of problematic 
substance use on therapy outcomes for these patients. 

Subjects, Materials and Methods 

Ethics statement 

AU data analyzed in this study came from existing patient 
registries. After intake, ICBT patients were sent written informa- 
tion that their data might be used in future research regarding 
treatment effectiveness. The information stated explicitly that the 
patient could ask for their individual data to be withdrawn from 
the patient registry. No informed consent form was signed by 
patients at this time. The study was granted ethical approval by the 
Stockholm Regional Ethics Review Board, ref nr 2011/1029-31/ 
5, August 18, 2011. The Board thus considered the patient 
information procedure ethically adequate for this study. 

Setting 

The ICBT clinic at Psychiatry Southwest in Stockholm- 
Huddinge (www.intemetpsykiatri.se) specializes in the develop- 



ment and delivery of ICBT within regular health and psychiatric 
care. Analyses have shown large within-group effect sizes for 
patients treated for major depressive disorder [24] panic disorder 
[25], and social anxiety disorder (El Alaoui, S., personal 
communication 22 October 2013) and maintenance of improve- 
ments 6 months after treatment. Baseline screening data on 
substance use are collected for all patients but the unit has not 
offered any internet-based treatment specifically for problematic 
substance use. Treatment at the ICBT unit includes self- 
assessment and 10-15 diagnosis-specific psycho-educational treat- 
ment modules, via a web-based communication platform with 
online therapist support. 

Recruitment and treatment procedure 

Patients are referred for treatment at the ICBT unit by a general 
practitioner or other physician, or self-referred. They complete 
web-based screening with diagnosis-specific screening instruments 
(see under Measures below) and are offered an intake appointment 
with a resident or speciahst psychiatrist for further clinical 
assessment and diagnosis with the Mini-International Neuropsy- 
chiatric Interview (MINI) [26]. All individuals who met with an 
intake psychiatrist between October 30, 2007 and June 16, 2010, 
and who went on to initiate treatment, were included in this study. 
Patients included either had an ongoing unipolar depression, panic 
disorder (with or without agoraphobia) or social anxiety disorder. 
At the intake appointment, a joint decision is made by the 
assessing psychiatrist and the patient on whether or not to begin 
ICBT treatment. In cases of comorbidity the psychiatrist and the 
patient jointly decide on which of the offered treatment programs 
is most suitable for the patient at the time. Patients are informed 
that participating in other concurrent psychotherapeutic treatment 
win make them ineligible to receive ICBT. Also, if patients are on 
medication, their medication needs to be stabilized for one month 
prior to initiating ICBT. Patients are referred elsewhere if they 
fulfill any of the following conditions rendering them unable to 
benefit adequately from the treatment: insufficient knowledge of 
Swedish, suffering from psychosis or bipolar disorder, substance 
use so severe it interferes with their ability to participate, or 
suicidal ideation to a degree that makes other, alternative 
treatment, more suitable. Approximately 40% of referred patients 
did not initiate ICBT treatment. 

AU patients participating in ICBT treatment were given access 
to an ICBT program with therapist contact via an online 
asynchronous communication system for a period of 12-15 weeks. 
The therapists were all clinical psychologists. Patients were 
instructed to work with one module per week and to contact the 
therapist at least once every week. Patients could contact their 
therapist at any time and expect a reply within 48 hours on 
weekdays. The depression and panic disorder treatments com- 
prised ten modules spanning over 12 weeks. The social anxiety 
disorder treatment was initially given in 1 5 modules over 1 5 weeks, 
but this was changed after the first year in regular care. The reason 
for this was that it is clinically more practical to administer a 
program over 12 weeks in order to avoid longer vacation periods 
in Sweden when patients are likely to be away (the summer 
months and winter holidays). In addition, in the original social 
anxiety disorder treatment, the final three modules were fairly light 
in content and it was possible to easily compress these into fewer 
modules with an expected maintained effect. The final format, 
with 12 modules over 12 weeks, is the one currendy used. Moving 
on to the next treatment module was contingent on completing 
exercises and answering module-specific questions. Access to 
therapist support was terminated after 12/15 weeks but access to 
the text modules was open for additional six months. The 
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treatment context has been described in more detail elsewhere 
[24,25]. 

Addressing suicidal ideation 

AU patients complete the Montgomery Asberg Depression 
Rating Scale ~ Self-rated (MADRS-S) weekly. An algorithm alerts 
the internet therapist, if the patient scores 4 or above on the 
suicidal ideation item (question 9) and the patient is contacted for 

in-person assessment. An automated alert is also sent out to the 
therapist if the patient stops interacting with the system for a 
period of seven days. The psychologist has access to the patient's 
phone number, and calls the patient if s/he stops communicating 
with the platform. The psychologist can also refer the patient for 
an emergency psychiatric appointment if deemed necessary. For 
acute circumstances, every patient has also provided the contact 
details of a close relative. 

Study population 

This study used retrospective data collected from ICBT patients 
in regular psychiatric care, and included 1601 patients screened 
for problematic alcohol and drug use, treated for depression 
(n = 770), panic disorder (n = 483), or social anxiety disorder 
(n = 347; 170 were offered 15 treatment modules and 177 were 
offered 12 modules). Twenty patients were excluded from analysis, 
one due to incorrect information on the number of treatment 
modules completed and 19 for whom scTcening data on the 
Alcohol Use Disorders Identification Test (AUDIT) and the Drug 
Use Disorders Identification Test (DUDIT) were missing, leaving 
a total population of 1581. 

Baseline measures 

The AUDIT [27] in Swedish translation [28,29], with well- 
established reliability and validity, was used to measure alcohol 
consumption and alcohol-related problems (total score range 0- 
40). In this study the term problematic alcohol use includes 
hazardous use (6-15 points for women [28] and 8-15 for men), 
harmful use (16-19) and probable dependence (20-40) [30]. The 
DUDIT, also with proven reliability and vahdity, measured illicit 
use of drugs and drug-related problems (total score range 0-44). In 
this study, problematic drug use includes hazardous use (1 for 
women and 1—5 for men), harmful use (2-24 for women and 6-24 
for men) as well as probable dependence (25-44) [29,31]. The 
GAF (Global Assessment of Functioning) [32], with demonstrated 
adequate validity and reUability [33], was used by the intake 
psychiatrist to rate patients' fimctional status (total score range 0- 
100). 

Continuous measures 

MADRS-S (Montgomery Asberg Depression Rating Scale — 
Self-rated) [34] was used to measure symptoms and severity of 
depression. MADRS-S is the self-rating version of MADRS [35], 
with a total score range of 0-54 [36] and good psychometric 
properties [37]. 

PDSS-SR (Panic Disorders Severity Scale - Self-Rating version) 
[38] was used to measure symptoms of panic disorder. The PDSS- 
SR is the self-rating version of the PDSS [39] and has a score 
range of 0-28 [40]. 

LSAS-SR (Liebowitz Social Anxiety Scale - Self-Rating version) 
[41] was used to measure social anxiety symptoms and severity. 
LSAS-SR is the self-rating version of LSAS [42] with a total score 
range of 0-144 [43]). 

AU patients completed the MADRS-S at baseline and up to 
once a week during treatment to measure depression severity. In 



parallel and at the same intervals, patients treated for panic 
disorder also completed the PDSS-SR and patients treated for 
social anxiety disorder completed the LSAS-SR. 

Imputation of missing values and statistical analyses 

Missing values at basehne for MADRS-S, PDSS-SR and LSAS- 
SR were imputed such that missing values were replaced by the 
first observation carried backward. Post-treatment missing values 
were rej)laced by the last prior observation carried forward. 

Descriptive statistics were used for participant characteristics 
and prevalence data. The number of treatment modules complet- 
ed by gender, age, diagnosis and problematic substance use were 
evaluated with ANOVA tests. To examine pairwise differences 
between groups in the analyses of variance, the Tukey-Kramer 
post-hoc test was used, taking into consideration unequal sample 
sizes, and controUing for mass significance [44]. Differences in 
therapy outcome by gender, age, diagnosis and levels of 
problematic substance use were tested using analyses of variance 
(ANOVA) and analyses of covariance (ANCOVA). 

For purposes of comparison, the number of treatment modules 
for the social anxiety disorder treatment groups were adjusted to fit 
a scale of 0-10, and this adjusted number was used in all reported 
means and analyses. 

To simplify interpretation of therapy outcomes over time, 
within-group effect sizes were calculated as Cohen's d by dividing 
the mean difference between pre- and post-measures by their 
pooled standard deviation. Comparisons between effect sizes were 
based on visual inspection. Interactive effects between treatment 
outcome and number of modules completed, GAF-scores, gender, 
age and diagnostic categories were analyzed using analysis of 
covariance (ANCOVA). All ANCOVA analyses used a reference 
group of individuals without problematic substance use, who were 
in the same category (e.g., gender or age). The IBM SPSS 
Statistical Package version 20 (IBM Corp, Armonk, NY, USA) for 
MacOS was used for all analyses. 

Results 

Participant characteristics 

Table 1 shows partit:ipant characteristics by diagnosis for 
gender, mean age, mean GAF score and number of completed 
treatment modules, with specified levels of problematic substance 
use. 

Substance use prevalence 

Among tlu- population of 1581 patients, problematic substance 
use was reported by 32.4%, with 24.1% indicating problematic 
alcohol use only, 4.6% reporting problematic drug use only and 
3.7% indicating combined problematic alcohol and drug use, with 
a total of 8.3% indicating problematic drug use with or without 
alcohol. The age range was 17 to 79. Patients treated for 
depression were slightly older than the population mean, whereas 
panic disorder and social anxiety disorder patients were younger. 
The mean GAF-score indicated moderate to mUd symptoms of 
difficulty in social, occupational or school functioning. A higher 
proportion of women than men were receiving ICBT treatment, 
particularly for depression and panic disorder. More men than 
women had harmful alcohol use, probable alcohol dependence 
and hazardous drug use as well as hazardous drug use combined 
with problematic alcohol use as measured with AUDIT and 
DUDIT respectively. In contrast, for harmful drug use the 
proportion of women was larger as well as for harmful drug use in 
combination with problematic alcohol use. 
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Number of treatment modules completed 

The number of treatment modules completed was analyzed by 
gender, age and diagnostic category across mutually exclusive 
categories of substanc:e use: non-problematic use, problematic 
alcohol use, problematic drug use and combined drug and 
problematic alcohol use. See Table 2. 

Tukey-Kramer post-hoc tests showed that men with problem- 
atic drug use completed, on average, 1 .4 fewer treatment modules 
than men without problematic substance use (p = 0.049). Among 
women, only those with combined problematic drug and alcohol 
use completed significantly fewer treatment modules (1.6 fewer 
modules) compared to patients without problematic substance use 
(^ = 0.018). 

Among 25 to 34-year-olds, those with problematic drug use 
completed an average of 1 .94 fewer treatment modules than those 
without problematic substance use (p = 0.008). In the group of 35 
to 64-year-olds, those with combined problematic alcohol and 
drug use completed, on average, 2.08 fewer modules than those 
without problematic substance use (p = 0.036). 

In the group treated for social anxiety disorder, an average of 
2.96 fewer treatment modules were completed by patients with 
problematic drug use (p = 0.002), as well as 2.30 fewer treatment 
modules among those with combined problematic alcohol and 
drug use (p = 0.023), compared to patients without problematic 
substance use. In the group treated for panic disorder, which 
showed significantly fewer completed treatment modules for 
problematic substance users overall, the post-hoc tests did not 
show any significant differences. 

Therapy outcomes 

A general over\'iew of therapy outcomes for the total population 
by diagnostic category across mutually exclusive substance use 
categories is shown in Table 3. Within-group effect sizes (Cohen's 
d) show effects over time for each problematic use category, and B- 
values based on ANCOVA analyses, controlled for MADRS-S, 
PDSS-SR and LSAS-SR baseline values, show mean differences in 
therapy outcome between problematic users in different catego- 
ries, compared to non-users who serve as the reference category 
throughout. 

Overall within-group effect sizes for MADRS-S were high. 
While effect sizes were generally high for patients treated for 
depression, they were nominally lower among those who had 
concurrent harmful drug use as well as hazardous drug use 
combined with problematic alcohol use. In contrast, higher within- 
group effect sizes occurred among hazardous alcohol users as well 
as hazardous drug users who were treated for depression Among 
patients treated for panic disorder, effect sizes according to the 
PDSS-SR ranged between fair and very high. Patients with 
harmful alcohol use and those with probable dependence on 
alcohol showed lower effect sizes. Again in contrast, higher effect 
sizes were identified in the panic disorder group for harmful drug 
users and those combining harmful drug use with problematic 
alcohol use. Effect sizes for patients treated for social anxiety 
disorder ranged from below zero to very high on the LSAS-SR, 
where patients with harmful alcohol use and hazardous drug use 
had lower effect sizes and the two patients who showed probable 
drug dependence in combination with problematic alcohol use 
had negative effect sizes. In the social anxiety disorder group, 
higher effect sizes were found for those with either probable 
dependence on alcohol or combined hazardous drug use with 
problematic alcohol use. 

The ANCOVA analyses showed that individuals with harmful 
drug use combined with problematic alcohol use negatively 
affected overall depression outcomes in the entire study popula- 



tion, with an average of 3.5 points post-treatment higher scores on 
the MADRS-S (not shown). However, among patients treated for 
depression, substance use did not affect improvement in depressive 
symptoms. In contrast, panic disorder patients with hazardous use 
of alcohol (1.29 points higher on the PDSS-SR) or probable 
dependence (5.29 points higher on the PDSS-SR) and social 
anxiety disorder patients with hazardous drug use (18 points 
higher on the LSAS-SR and 5.03 points higher on the MADRS-S) 
had worse therapy outcomes than non-using patients within their 
respective diagnostic categories. The two individuals with probable 
dependence on drugs combined with problematic alcohol use in 
the social anxiety disorder groups differed highly significantiy from 
the non-users in the same diagnostic category. 

Effects of problematic use on therapy outcomes, 
controlling for gender, age, baseline GAP and screening 
scores and number of completed modules 

Separate ANCOVA analyses were conducted with therapy 
outcome as the dependent variable, controlling for age, gender, 
initial OAF score, baseline MADRS-S score, problematic use, 
treatment group and number of modules completed. Due to 
missing data on GAF, the number of individuals in the sample was 
1316. 

For the group treated for depression, problematic alcohol and 
drug use did not affect MADRS-S outcomes. However, GAF 
(B= -0.14, p = 0.003), ba.seline MADRS-S scores (B = 0.42, p< 
0.001) and number of completed modules (B= -1.14, p<0.001) 
significantiy affected MADRS-S outcomes in the depression 
group. For the group treated for panic disorder, controlling for 
PDSS-SR baseline values and analyzing PDSS-SR outcomes, 
GAF (B=-0.08, p = 0.001), baseline PDSS-SR scores (B = 0.32, 
p<0.001) and number of completed modules (B=— 0.59, p< 
0.001) significantly affected outcomes, and individuals with 
problematic alcohol use (B = 1.55, p — 0.008) had worse outcomes 
than those without problematic substance use. An in-depth 
analysis of the substance us(^ subc'atc'g()ri(^s in tlu^ panic disorder 
group showed that pati('nts with c'xclusi\'e hazardous alcohol use 
(B = 1.29, p = 0.035) and patients with exclusive probable alcohol 
dependence (B = 6.35, p = 0.005) had worse outcomes on PDSS- 
SR than patients without problematic substance use. For the social 
anxiety disorder group, GAF (B = —0.36, p = 0.046), baseline 
LSAS-SR scores (B = 0.67, p<0.001) and the number of modules 
completed (B = —1.48, p<0.001) affected outcomes and individ- 
uals with problematic drug use had significantly wor.se outcomes 
than patients in this group without problematic substance use 
(B= 12.431, p = 0.053). An in-depth analysis of the substance use 
subcategories in the social anxiety disorder group showed that 
patients with exclusive hazardous drug use (B = 13.70, p = 0.039), 
patients with combined problematic alcohol use and hazardous 
drug use (B = —47.62, p<0.001) as well as patients with combined 
problematic alcohol use and probable drug dependence 
(B = 35.80, p = 0.008) had worse outcomes on LSAS-SR tiian 
patients without problematic substance use. 

Discussion 

Generally, according to GAF scores, patients in this study 
consisted of fairly highly functioning individuals, regardless of 
substance use severity. The overall prevalence of problematic 
substance use in the patient population was 32%, with 28% 
problematic alcohol use and 8% problematic drug use, levels 
higher than in previous studies of patients in psychiatry [3,4] as 
well as the general population [5] . A larger proportion of patients 
overall were women, but we found more men in the categories of 
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more severe alcohol use and hazardous drug use. Our finding that 
severe alcohol use was more prevalent among men than among 
women is consistent with earlier studies [5,45]. The total 
prevalence of problematic substance u.se by diagnostic group was 
lowest among patients treated for panic disorder (29%), followed 
by depression (33.4%) and social anxiety disorder (35.5%). 

Treatment outcomes for the total population in terms of 
depression ratings were good, with large efiect sizes (Cohen's d 
0.81 to 1.09) regardless of problematic use. This implies that 
concurrent problematic substance use is not an obstacle to 
obtaining good efiects from ICBT treatment, with a clear 
exception in the two individuals in the social anxiety disorder 
group who had combined problematic alcohol use and probable 
drug dependence. In terms of specific diagnoses, treatment 
outcomes for depression were not affected by problematic 
substance use. II()\\x'\-er, among patients treated for panic 
disorder, hazardous drug use (80 individuals) and probable alcohol 
dependence (5 individuals) did negatively alfect specific outcomes. 
For social anxiety disorder, the 1 2 individuals with hazardous drug 
use and the two with probable drug dependence combined with 
problematic alcohol use had worse specific treatment outcomes. It 
is worth noting that some substance use categories in each 
treatment goup seemed to fare better in terms of within-group 
effect sizes than non-problematic users. In the social anxiety 
disorder group, those with probable alcohol dependence and 
hazardous drug use combined with problematic alcohol use did 
better than the non-problematic users. These particular findings 
would be in conflict with the theoretical view that alcohol and drug 
use function as safety behaviors for persons dealing with social 
anxiety, serving to protect the individual from dreaded exposure to 
anxiety. Not experiencing the feared situation in a sober state 
could hinder patients from disconfirming erroneous beliefs about 
the consequences of anxiety in social situations, therefore 
hampering therapeutic progress [46]. 

In the depression group, better effect sizes occurred for 
hazardous alcohol or hazardous drug users, but not for those 
with combined use. Finally, in the panic disorder group patients 
with probable dependence on alcohol or combined hazardous 
drug use with problematic alcohol use did better in therapy than 
non-problematic users. The cause of the improved therapeutic 
outcomes in these groups is not clear from our data, and further 
investigation into when substance use and therapy have a 
synergistic elfect, and the possible mechanisms behind this could 
be warranted. What is clear is that these results are well in line 
with the argument that ICBT seems to have good results in 
presence of problematic substance use for these groups. 

Problematic substance use negatively affected the number of 
completed treatment modules to a certain extent, with some 
gender and age effects. Problematic substance use seems not to 
have affected the number of modules completed in patients under 
25 years of age. Among those older, there were effects of either 
problematic drug use alone (25-34 years) or the combination of 
problematic alcohol and drug use (35—64 years). Interpreting data 
on the number of completed treatment modules presents some 
challenges. In the ICBT unit's experience, completing more 
treatment modules is associated with better outcomes, but an exact 
defining point regarding the need for individuals to complete a 
certain number of modules is elusive: some patients benefit the 
most early on and subsequently lessen their activity in the program 
without prejudicing good outcomes. Thus there is great variability 
between individuals regarding the efiects of quitting treatment 
early on therapy outcomes. Nonetheless, the significant overall 
association between number of modules completed and positive 



outcome justifies the ambition of ensuring a high rate of completed 
modules among patients. 

Strengths and limitations 

To our knowledge this is the first study of substance use in a 
population receiving psychotherapeutic tieatment over the Inter- 
net in regular care. Major strengths of this study are that the data 
were collected in a non-experimental naturalistic clinical setting, 
and the sizes of the treatment groups studied were large with 
nearly complete data sets. These factors suggest high external 
validity for our findings. Also, the study used well validated 
measures of substance use and symptom severity. 

At the same time, the retrospective design led to several 
limitations that should be noted. First, our analyses were limited to 
data that had already been collected at the clinic, thus omitting 
potentially vital data for this type of study. For instance, no data 
were collected on the types of drugs used by patients. We were 
thus unable to establish any connection between type of drug use 
and therapy outcomes. A substance that is of relevance to the 
study, but was not addressed in the substance use screening, is 
nicotine. There is a known connection between nicotine and 
psychiatric comorbidity [47], particularly affective disorders 
[48,49]. Nicotine use would therefore constitute a valuable 
observation in relation to patient outcomes. Second, the data 
did not include any information on simultaneous medication 
parallel to ICBT treatment, nor on access to other treatment 
providers. What we did know was that psychiatric medication 
needed to be stable for one month prior to beginning ICBT and 
that patients receiving concurrent psychotherapy were not eligible 
for ICBT. Simultaneous complementary (e.g., substance use) or 
alternative treatment access could significantiy affect patient 
outcomes, and lack of this information could bias our conclusions. 
Third, no data were available on individuals who were referred for 
ICBT treatment but never began therapy. 

An additional limitation is that clinical exclusion of patients with 
severe substance use may have affected population characteristics 
and led to results biassed for better functioning patients with less 
severe substance use problems. At the same time, in this study we 
were limited to using self-reported data on substance use, and 
research has shown that self-report data may be subject to bias in 
form of underreporting actual use [50,5 1] , so consumption levels 
may have been higher than we knew. Indeed, if the self-reported 
substance use in this study was underreported by the patients, this 
would lend further strength to the conclusion that ICBT is 
effective even at slightly higher levels of problematic use. Of 
course, this reasoning is only speculative. Nonetheless, some 
studies have shown that respondents report higher consumption of 
substances when filling out self-report instruments on a computer 
in comparison to paper questionnaires, so actual use may have 
been reported relatively correctly [52,53]. In any case, in the 
absence of corroborative measures of substance use, for example 
biological markers, we were not able to evaluate the validity of the 
level of substance use reported by patients. A further limitation 
concerned the classification of patients in categories of mutually 
exclusive types of substance use, which in some cases led to very 
small groups. It is unclear whether these would be representative 
of future patient populations, even if the our patients did constitute 
the entire population of patients at the ICBT unit during the time 
period studied. A final limitation is the fact that the substance use 
categories defined were based on baseUne measures, since the 
naturalistic study design did not include follow-up measures of 
substance use. This makes it impossible to know whether changes 
in initial substance use categories occurred during treatment and 
how this in turn might have affected treatment outcome. 
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Future research 

Future research should use a prospective design, where 
important data that were missing in this study could be included. 
Information on types of substances and concurrent medication 
used by the participating parties would make for analyses 
providing more information on the actual elfects on therapy and 
also a more detailed prevalence description. A more in-depth 
study of substance use and therapy progress during the actual 
treatment period could investigate why certain user categories 
seem to do better in therapy than their non-problematic 
counterparts. Data on reasons for exclusion gathered by admitting 
psychiatrists would further add knowledge about the patient group 
studied and add information on generalizabUity to a psychiatric 
population. 

Conclusion 

The results indicate that problematic substance use generally 
does not alfect the outcome of ICBT. In most cases, problematic 
substance use had no discernible detrimental effect on outcomes, 
suggesting no obstacle to providing individuals with ICBT based 
on problematic substance use. It should be noted, however, that 
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